T 

AD-A089  952 


F/6  1 


unclassified 


HARRIS  CORP  MELBOURNE  FLA 
DATA  HANDLING  RECORDING  SYSTEM  <DHRS>.<U> 
jUL  80  ME  TAYLOR  F30602-79-C-0268 

RADC-TR-80-198  NL 


I  I 


RADC-TR-80-1 98 

Final  Technical  Raport 
July  1980 


AD  A0899  52 

DATA  HANDLING  RECORDING 
SYSTEM  (DHRS) 

Harris  Corporation 

Dr.  W.E.  Taylor 


APPROVED  FOR  PUBLIC  RELEASE;  DISTRIBUTION  UNLIMITED 


DTIC 

jj’.iL.ECTEj 

OCT  6  1980 


ROME  AIR  DEVELOPMENT  CENTER 

Air  Force  Systems  Command 

Griff iss  Air  Force  Base,  New  York  1 3441 


3 


■  '  80  10  6  078 


This  report  has  been  reviewed  by  the  RADC  Public  Affairs  Office  (PA)  and 
is  releasable  to  the  National  Technical  Information  Service  (NTIS).  At  NTIS 
it  will  be  releasable  to  the  general  public,  including  foreign  nations* 

RADC-TR-80-198  has  been  reviewed  and  is  approved  for  publication. 


Project  Engineer 


APPR0VED: 

OWEN  R.  LAWTER,  Colonel,  USAF 

Chief,  Intelligence  and  Reconnaissance  Division 


FOR  THE  COMMANDER: 


Acting  Chief,  Plans  Office 


SUBJECT  TO  EXPORT  CONTROL  LAWS 

This  document  contains  information  for  manufacturing  or  using  munitions  of  war. 
Export  of  the  information  contained  herein,  or  release  to  foreign  nationals 
within  the  United  States,  without  first  obtaining  an  export  license,  is  a 
violation  of  the  International  Traffic  in  Arms  Regulations.  Such  violation 
Is  subject  to  a  penalty  of  up  to  2  years  imprisonment  and  a  fine  of  $100,000 
under  22  U.S.C  2778. 

Include  this  notice  with  any  reproduced  portion  of  this  document. 

If  your  address  has  changed  or  if  you  wish  to  be  removed  from  the  RADC 
mailing  list,  or  if  the  addressee  is  no  longer  employed  by  your  organisation, 
please  notify  RADC(IRRE)  Grlfflss  AFB  NY  13441.  This  will  asslst.ua  in 
maintaining  a  current  mailing  list. 


Do. not  return  this  copy.  Retain  or  destroy 


k UNCLASS I FT ED 


secur^y  ctAl&mcATiow  of  this  page  (Wh**t 

\  ] Tfj  REPORT  DOCUMENTATION  PAGE  T“  B  EFOKEDCOMPL  ETWG^ORM 

t  nrrWpii  jfflinrn — h  govt  accession  no.  3  recipient’s  catalog  number 

RADc/rR-^-198 J  ^  Ad{ ^ 

I*— ITtLe  tm>lju+mTZ>  _  _ _ _  atnnRT-A  RERtgtfctfc'gR 


\TA  HANDLING  ^RECORDING  SYSTEM  (DHRS) 


E.j  Taylor 


s  5.  jrvrjijj/ bebort  a  r  riili^frrf^rnrn 

q  Flnai^echnical  Report ' 

~  1  Oct  79  —  31  Mar  8/ 

1  t.  PEAfOWWW^tC;  tttPOR^tfUMBER 

_ N/A _ 

I.  CONTRACT  OR  GRANT  NUMBER/^ 


If  3,0602  -7  9-C-02  68 


S  PERFORMING  ORGANI  Z  ATlON  N  AM  t  AND  ADDRESS 

Harris  Corporation 
PO  Box  37 

Melbourne  FT,  32.9.Q1 _ ~ — - 

II.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

Rome  Air  Development  Center  (IRRE) 
Criffiss  AFB  NY  13441 


PROGRAM  ELEMENT.  PROJECT.  TASK 
ARE*  A  WORK  UNIT  NUMBERS 


-622Q8F 

665A0OO3 


/ 1 Q 


JJis 


ul^r^j80 

is.  ,miyagn  ftr  otrct 


ru  MONITORING  AGEN<  Y  NAME  a  ADDRESS)'//  ditleutoLltom  Controlling  Office)  1  15.  SECURITY  CLASS,  (of  thim  report) 


12  jOL 


UNCLASSIFIED 

Tsi  ~OECL  ASSI  Fl  CATION/ DOWNGRADING 

N/A  SCMe0ULE 


I  16  DISTRIBUTION  STATEMENT  (ol  this  Report) 


Approved  for  public  release;  distribution  unlimited 


I  17.  DISTRIBUTION  STATEMENT  (of  the  mhstrmct  entered  i/i  fllnck  20,  If  dit tor *mt  from  Report) 


16  SUPPl  EMI  N  T  ARY  NOTES 


IRADC  Project  Engineer:  Andrew  R.  Pirich  (IRRE) 


M9  KEY  WOROS  (Conttnum  on  revet**  *i,le  if  necmeemry  mn,1  identify  by  block  number) 


Real-Time  Processing 
Detect  ion 
Identification 
Reporting 


Digital  Imagery 
Enhancement 


20  ABSTRACT  (Continue  <*o  r»vtri*  tide  If  neceeemry  and  Identify  by  block  number) 

The  final  technical  report  submitted  by  Harris  Corporation  contains  a 
brief  synopsis  of  the  preliminary  design  criteria  for  the  fabrication  of 
the  DHRS  during  Phase  II.  An  analysis  is  presented  of  the  hardware  desigi 
to  handle  10-^  bits  of  digital  imagery  data.  Harris  Corporation  provides 
a  hierarchical  software  technique  in  handling  the  voluminous  amount  of 
imagery  data  without  degradation  to  the  Imagery  and  employing  a  single 
(MTU)  magnetic  tape  unit. 

DO  1473  EDITION  or  I  NOV  «t\^pBSOLE  TE 

1  JAN  71  r~er  *  7  \  Hun  iPCTrTPn 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  /«*»•#»  t>f 


jst  (2  o 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PMKOw  Ml  KM ml 


I 


TABLE  OF  CONTENTS 


Title 


ABSTRACT  . 

STATEMENT  OF  THE  PROBLEM 

TECHNICAL  OBJECTIVE  _ 

TECHNICAL  APPROACH  . 

SUMMARY  OF  RESULTS  . 

CONCLUSIONS  . 


EVALUATION 
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areas  designated  within  the  SOW,  e.g.,  handling  10  bits  of  data,  storage 
and  retrieval,  automatic  detection  and  classification  of  targets  from  FLIR 
(Forward  Looking  IR)  and  DLIR  (Downward  Looking  IR)  Imagery,  and  Image 
interpretation  (IR)  functions  for  generating  tactical  reports. 

The  DHRS  design  appears  to  be  technically  feasible  and  cost  effective, 
and  is  a  primary  thrust  in  developing  an  all  digital  multi-sensor  tactical 
ground  exploitation  system. 
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I.  ABSTRACT 

This  final  report  presents  the  results  of  the  Data  Handling  Recording 
System  (DHRS)  study  effort  to  define  and  specify  an  architecture  for  the  purpose 
of  Ingesting,  storing,  exploiting,  and  verifying  reconnaissance  Imagery.  The 
defined  architecture  consists  of  four  functional  modules:  Sensor  Input  Module 
(SIM),  Storage  and  Retrieval  Module  (S/RM),  Real-Time  Processing  Module  (RTPM), 
and  Near  Real-Time  Exploitation  Module  (NRTEM).  These  functional  modules  and  the 
associated  hardware  subsystems  will  perform  the  Ingest,  handling,  and  display  of 
the  required  sensor  data  types.  To  obtain  a  more  detailed  description  of  any 
particular  facet  of  the  DHRS,  refer  to  one  of  the  following  applicable  documents: 

"DHRS  System/Subsystem  Specification,"  Harris  Corporation  GCSD, 

March  1980. 

"DHRS  Functional  Description,"  Harris  Corporation  GCSD,  March  1980. 

"DHRS  Data  Base  Specification,"  Harris  Corporation  GCSO,  March  1980. 

"DHRS  Data  Requirements  Document,"  Harris  Corporation  GCSO,  March  1980. 

"DHRS  Technical  Proposal,"  Harris  Corporation  GCSO,  March  1960. 

RADC  Contract  "DHRS  IF30602-79-C-0268,"  dated  28  September  1979, 
Unclassified. 


II. 


STATEMENT  OF  THE  PROBLEM 


Since  World  War  II,  commanders  have  lost  opportunities  to  destroy  enemy 
targets  because  of  the  delay  between  target  observation  and  dispatch  of  weapon 
systems.  To  this  day,  that  delay  Is  several  hours,  plenty  of  time  for  enemy 
aircraft,  tanks,  ships,  and  convoys  to  relocate.  The  Harrls/WEC  DHRS  allows 
real-time  target  reporting  and  Increased  utilization  and  efficiency  of  deployed 
forces . 


Only  a  few  frames  are  needed  by  the  Image  Interpreter  (I/I)  to  locate 
all  the  targets  In  a  2-mlnute  mission  covering  four  target  sites.  Yet,  today  the 
I/I  examines  all  the  collected  frames. 

The  Harrls/WEC  DHRS,  the  unique  solution  to  the  reconnaissance  cycle 
problem,  reduces  processing  time  from  several  hours  to  several  minutes. 

After  proof  of  concept  using  the  DHRS  advanced  development  model  has 
been  demonstrated,  the  far  term  solution  will  utilize  an  airborne  screener. 
Airborne  screening  allows  only  that  small  portion  of  the  sensed  Imagery  containing 
targets  to  be  transmitted,  thus  realizing  a  tremendous  reduction  In  required  data 
link  bandwidth.  Sufficiently  low  data  rates  permit  the  use  of  anti-jam  equipment 
In  hostile  environments  or  HF  over-the-horizon  data  links,  thus  eliminating  the 
need  for  expensive  data  relay  aircraft. 

The  Harrls/WEC  DHRS  Configuration  evolved  through  a  series  of  baseline 
iterations.  The  resulting  configuration  may  be  easily  adapted  to  a  hostile 
environment  or  to  a  scenario  utilizing  real-time  "on-board"  screening  of  target 
data. 
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III.  TECHNICAL  OBJECTIVE 

The  need  for  the  DHRS  Is  based  on  decreasing  the  time  delay  associated 
with  the  reconnaissance  cycle.  The  problem  of  decreasing  this  time  delay  can  be 
solved  in  several  ways.  This  paragraph  will  describe  the  reconnaissance  cycle 
time  problem,  an  assumed  reconnaissance  scenario,  and  potential  solutions. 

The  efficiency  with  which  the  Tactical  Air  Forces  deliver  weapons  on 
enemy  targets  is  determined.  In  part,  by  data  collected  by  reconnaissance 
aircraft.  If  the  location  of  tanks,  trucks,  aircraft,  and  armored  vehicles  are 
unknown,  they  cannot  be  destroyed. 

During  the  past  three  decades,  substantial  progress  has  been  made  In 
collection  instrunents;  infrared  sensors  are  capable  of  day  and  night  sensing  of 
enemy  targets.  The  Instrument  measurements  are  recorded  directly  via  magnetic 
tape,  thereby  eliminating  the  need  to  develop  film.  The  technology  of  electro 
optics  has  also  been  applied  to  Image  collection  and  the  quality  of  collected  data 
has  been  constantly  improved. 

Yet,  the  process  by  which  Image  interpreters  extract  targets  from 
Images  has  changed  little  since  World  War  II.  While  it  is  true  that  neither 
infrared  imagery  not  tape  recording  of  Images  existed  at  that  time,  the  manual 
image  interpretation  process  was  similar. 

Present  day  reconnaissance  consists  of  four  steps: 

1.  Aircraft  mission  to  collect  Imagery  on  video  tapes. 

2.  Off  load  the  recorded  Imagery. 

3.  Interpret  the  contents  of  the  recorded  imagery. 

4.  Generate  and  distribute  reports  of  target  locations. 

These  steps  normally  take  several  hours  even  to  process  a  2  minute 
mission.  Processing  time  Is  long  because  of  data  management,  not  because  of 
target  Identification.  Two  minutes  of  collected  FLIR  data  amounts  to  3600  frames 
of  data.  Because  many  of  the  frames  do  not  contain  targets,  the  job  of  detection 
and  classification  is  a  long,  slow  process. 
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Sunmarlzlng,  the  reconnaissance  cycle  time  problem  consists  of  the 
transportation  delay  associated  with  carrying  the  video  tape  from  the  target  site 
to  the  image  Interpreter,  and  the  Interpretation  delay  associated  with  detecting 
and  classifying  target. 

In  the  future  the  reconnaissance  cycle  time  problem  will  be  solved  with 
an  airborne  screener/classifler.  The  airborne  screener/classlfler  will  remove 
subframes  containing  targets.  These  subframes  will  then  be  transmitted  to  a 
ground-based  exploitation  system  via  a  data  link.  The  reconnaissance  cycle  time 
problem  is  reduced  to  a  verification  problem  with  the  human  image  Interpreter 
being  the  sole  source  of  delay. 

Until  airborne  screener/classlfiers  become  a  reality,  the  solution  to 
the  reconnaissance  cycle  time  problem  will  evolve  to  a  point  such  that 
transportation  and  processing  delay  is  minimized  through  the  use  of  the  DHRS  and  a 
wide  band  data  link.  The  data  link  will  be  used  to  transmit  Imagery  data  from  the 
aircraft  to  the  OHRS.  The  data  link  will  be  able  to  support  both  analog  and 
digital  data,  and  the  DHRS  will  perform  the  same  functions  as  described  in  the 
executive  summary.  This  solution  to  the  reconnaissance  cycle  time  problem  will 
consist  of  a  RF  link  and  automated  image  interpretation,  l.e.,  automatic  detection 
and  classification  of  targets,  supplemented  by  computer  assisted  verification. 

The  proposed  DHRS  will  provide  a  solution  to  the  reconnaissance  cycle 
time  problem  similar  to  the  intermediate  solution.  The  current  solution  differs 
from  the  Intermediate  solution  only  In  the  delay  associated  with  the 
transportation  of  the  video  tape  to  the  image  interpreter.  There  1$  a  natural 
evolution  from  the  DHRS  to  the  far  term  solution. 

For  the  purposes  of  developing  the  requirements  for  the  OHRS,  tne 
assumed  reconnaissance  scenario  shall  be  as  follows.  A  typical  mission  will  be 
two  minutes  In  duration.  The  mission  will  consist  of  a  reconnaissance  aircraft 
visiting  four  target  sites,  and  collecting  30  seconds  of  Imagery  at  each  site. 
Figure  1  shows  a  time  line  corresponding  to  this  mission  scenario.  The  contents 
of  each  30  second  data  segment  consist  of  frames  containing  targets,  surrounded  by 
frames  containing  no  targets.  The  number  of  frames  containing  targets  will  vary. 
For  the  purposes  of  computation  only.  It  will  be  assumed  that  there  exists  one 
frame  containing  targets  midway  between  the  ends  of  the  30  second  segment. 


MISSION  TIME  *  2  MINUTES  — 


30 

SECONDS  — — 


A90431-82 


Figure  1.  Assumed  Typical  Mission  Scenario 


IV 


TECHNICAL  APPROACH 


The  DHRS  considerations  discussed  in  this  section  lay  the  groundwork 
for  the  design  by  developing  the  implied  system  and  subsystem  requirements.  These 
implied  requirements  in  conjunction  with  the  specific  requirements  of  the 
Statement-of-Work  form  the  basis  for  designing  DHRS. 

This  section  presents  an  evolution  of  DHRS  as  a  solution  to  the 
reconnaissance  problem.  The  DHRS  functional  partitioning  is  presented  and  the 
subsystems  are  described.  The  impact  of  present  and  future  sensor  characteristics 
upon  the  system  is  discussed  in  terms  of  data  rates  and  image  segmentation.  The 
various  contributors  to  system  throughput  delay  are  presented  and  the 
computationally  intensive  navigation  and  rectification  functions  are  discussed. 

The  problem  as  defined  by  Harris  is  to  provide  a  system  configuration 
composed  of  the  following  functional  modules  comprising  the  Data  Handling  and 
Recording  System. 

Either  recorded  data  from  the  video  tapes  or  real-time  data  from  a  data 
link  receiver  will  be  directed  to  the  Sensor  Input  Module  (SIM). 

1.  The  Sensor  Input  Module  must  be  able  to: 

a.  Accept  video  tape  data  from  the  recorders  of  (Pave  Tack)  FUR 
and  AN/AAD-5  sensors 

b.  Accept  direct  analog  data  or  direct  digital  data  from  the  same 
when  it  becomes  available  with  minimal  modification  to  the  SIM 

c.  Provide  appropriate  a/d  conversion  for  utilizing  the  analog 
data  in  a  digital  environment 

d.  Accept  digital  data  rates  of  up  to  140  Megabits/second 

e.  Accept  and  route  navigation,  timing,  and  sync  data 

f.  Accept  preprocessed  data 

g.  Format  Image  data  for  storage  or  "real-time"  processing 

From  the  SIM,  the  formatted  digital  data  will  be  routed  to  two  modules 
simultaneously:  the  "Real-Time"  Processing  Module  (RTPM)  and  the  Storage  and 
Retrieval  Module  (S/RM). 
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The  RTPM  implements  the  target  detection/classification  function' within 
the  DHRS.  The  necessary  requirements  for  performing  the  target  screening  Include, 
but  are  not  limited  to,  the  RTPM  real-time  enhancement  techniques  given  in  the  SOW. 

2.  The  Real-Time  Processing  Module  must  perform  the  following  tasks. 

a.  Automatic  Target  Screening 

b.  "Real-Time"  Image  Enhancements 

c.  "Real-Time"  Target  Detection 

d.  "Real-Time"  Target  Identification 

e.  Image  Segmentation 

The  output  of  the  RTPM  will  be  a  list  of  target  frames,  used  by  the 
Near  Real  Time  Exploitation  Module  (NRTEM)  to  retrieve  display  size  images  from 
the  S/RM. 

3.  The  Storage  and  Retrieval  Module  must  have  the  following 

Characteri sties: 

a.  Equivalent  of  10^  bits  of  storage 

b.  Ability  to  input  and  output  data  at  more  than  140  Mb/sec 

c.  Image  decimation 

d.  Image  Segmentation  for  Storage  and  01  splay 

Two  of  these  characteristics  are  specified  in  the  SOW  as  RTPM  functions 
(i.e.,  decimation  and  segmentation)  but  are  more  efficiently  implemented  in  the 
S/RM. 

From  the  S/RM,  a  decimated  full-frame  Image  (DLIR),  a  segmented 
subframe  image  (DLIR),  or  a  full-frame  full  resolution  image  (FLIR)  is  routed  to 
the  Image  Queue,  residing  in  the  Near  Real  Time  Exploitation  Module  (NRTEM). 

The  NRTEM  will  provide  the  Man-Machine  Interface  and  the  overall  system 
control  for  the  DHRS,  translating  target  frame  cues  to  retrieval  requests  from  the 
Ingested  Image  data  and  providing  an  interactive  Image  evaluation  and  processing 
capabi lity. 


4.  The  Near  Real-Time  Exploitation  Module  provides  the  following 
capabi lty: 

a.  System  Control 

b.  Image  Display  and  Storage  (Including  Image  Queue) 

c.  Automatic  Retrieval  of  Cued  Subimages 

d.  Voice  Input  and  Communications  Interface 

e.  Image  enhancements  (Including  rectification  and  pixel 
mensuration) 

f.  Data  Management  with  Action/Interaction  reporting  capability 

g.  Exploitation  Output  Capability 

h.  Coordinate  Conversion 

The  modules  are  connected  by  a  network  or  bus  structure  which  provides 
an  efficient,  low  risk  method  for  transferral  of  Image  data  and  system  control 
commands . 

5.  Internal  Distribution  Subsystem 

a.  Full -Frame  Image  Transfer 

b.  Subframe  or  Display  Image  Transfer 

c.  System  Control  and  Status 

The  Function  partitioning  and  module  interconnection  is  shown  In 

Figure  2. 

Operational  Modes  (User  Scenario) 

The  DHRS  will  provide  three  modes  of  operation  for  the  Image 
Interpreter  (I/I).  These  modes  consist  of: 

1.  Pre  Mission  or  Configuration  Mode 

2.  Auto  Q  or  Mission  Mode 

3.  Post  Mission  Mode 

The  premission  mode  will  consist  of  Initialization  of  the  DHRS 
modules.  The  SIM  Initialization  will  consist  of  selecting  the  sensor  type  for  a 
given  mission.  The  I/I  will  then  Initialize  the  application  processors  which  are 
part  of  the  S/RM,  the  display  and  the  Target  Screener.  The  S/RM  initialization 
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will  consist  of  moving  the  tape  to  the  next  available  location  for  recording  and 
transferring  the  mission  report  identification  to  the  tape  as  a  header.  The 
mission  report  identification  will  not  only  be  sent  to  the  S/RM,  but  also  it  will 
be  saved  by  the  SCM  as  part  of  the  report  generation  function.  The  System  Control 
Module  will  be  responsible,  during  the  premission  mode,  for  checking  the  S/RM  tape 
footage  count  and  reporting  this  to  the  I/I.  The  operator  voice  characteristics 
will  be  down-loaded  to  the  voice  recognizer.  Target  priorities  may  be  selected 
for  the  auto  retrieval  of  targets,  and  finally  if  LORAN  navigation  calculations 
will  be  necessary,  the  LORAN  station  coordinates  will  be  selected.  The  Image 
Display  will  be  initialized  by  clearing  the  display  screens,  resetting  image 
queue,  setting  the  cursor  location  and  down-loading  of  any  function  tables  for 
table  lookup. 

The  Auto  Q  or  mission  mode  can  be  divided  into  two  distinct 
operations.  The  first  will  consist  of  the  ingest  of  data,  formatting  and  routing 
to  the  S/RM  and  RTPM,  and  the  screening  of  images.  The  second  operation  will 
consist  of  automatic  retrieval  of  targeted  frames  and  the  verification  of  the 
target  classifications. 

The  first  operation  of  ingest,  format,  store,  and  screen  will  be  done 
automatically,  without  I/I  assistance.  The  ingest  function  will  include  header 
extraction  and  routing,  A/D  conversion,  formatting  for  storage  and  processing, 
rectifying  DLIR  imagery,  and  packing  the  data  (for  transfer  efficiency).  The 
storage  of  digital  data  will  be  performed  simultaneously  with  screening  of  the 
imagery.  The  storage  of  the  digital  data  consists  of  transferring  image  frames, 
documentation,  and  sync  and  search  headers  to  the  S/RM  magnetic  tape.  The 
screening  will  consist  of  detecting  targets  within  image  frames,  classifying 
detected  targets  and  routing  information  to  the  SCM  for  storage  on  the  data  base. 

The  second  operation  will  consist  of  image  retrieval,  queue  loading, 
and  I/I  exploitation.  The  image  retrieval  will  occur  automatically,  and  will 
provide  for  down-loading  of  image  frame  numbers  from  the  SCM  to  the  S/RM  control 
processor.  The  S/RM  control  processor  will  translate  the  frame  number  Into  an 
actual  tape  location  using  auxiliary  track  information.  The  resolution/subframe 
control  is  loaded  with  the  tape  location.  As  the  Image  Is  extracted  from  the 
tape,  the  navigation  data  is  sent  to  the  SCM  for  processing  and  eventual  display. 
The  image  queue  loads  the  display  with  Images  until  the  queue  is  nearly  empty.  At 
this  time  more  frames  are  requested  from  the  S/RM. 
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Once  the  Image  is  displayed,  along  with  annotation,  the  I/I  may  perform 
any  number  of  Image  enhancements  and  rectification  processes.  As  each  target  Is 
verified,  the  I/I  will  be  provided  with  an  automatic  target  reporting  facility. 

The  report  generation  Is  in  key-entry  format  with  as  much  data  transfer  directly 
from  the  target  verification  activity  as  possible.  As  targets  are  exploited,  the 
queue  empties.  When  the  queue  reaches  a  specified  level,  the  S/RM  will  ship 
additional  frames  to  the  image  queue.  The  frame  retrieval.  Image  queue  loading, 
and  image  exploitation  continues  until  all  frames  collected  have  been  serviced. 

The  post-mission  mode  will  be  used  for  re-processing  or 
enhancement/exploitation  of  images.  The  I/I  can  manually  retrieve  and  route 
specific  Imagery  data  from  the  S/RM  to  the  Image  queue,  and  to  the  display.  Once 
in  the  image  display,  the  I/I  may  perform  enhancements,  rectification,  or 
restoration  processing  functions.  The  I/I  may  re-route  frames  to  the  screener  for 
reevaluation  (just  as  in  the  mission  mode). 

Sensor  Characteristics 


The  Data  Handling  Recording  System  (DHRS)  will  necessarily  accept  the 
required  sensor  data  types  and  format  this  data  for  real-time  processing  and/or 
storage.  Initially,  the  DHRS  will  accept  Image  data  from  the  recorders  of  Pave 
TACK  FLIR  and  AN/AAD-5  data  in  analog  form.  The  preliminary  data  will  be  stored 
in  video  form  on  a  standard  video  cassette  recorder  for  the  FLIR  and  In  analog 
form  on  the  RCA  Advisor-62  VTR  for  the  AN/AAD-5.  Future  data  types  Include  Second 
Generation  FLIR,  downward  looking  IR  (DLIR),  and  ESSWACS  sensor  data.  The 
acceptance  of  these  varied  sensor  data  types  reflects  the  need  for  a  flexible, 
reconfigurable  architecture  such  that  the  same  hardware  may  be  used  for  most  of 
the  conditioning  functions. 

The  current  sensors  Impacting  the  design  of  the  SIM  include: 

1.  AN/AAQ-9  Forward  looking  infared  (FLIR)  sensors 

2.  AN/AAD-5  Downward  looking  Infared  (DLIR)  sensors 

3.  Electronic  Solid  State  Hide  Angle  Camera  System  (ESSWACS) 

Downward  looking  Visible  sensor 

Each  of  the  sensor  types  and  their  particular  characteristics  are 
discussed  in  the  following  paragraphs.  A  description  of  the  Implementation  method 
for  the  Ingest  of  each  sensor  data  type  is  provided  In  Pa-agraph  4.1  of  the 
Technical  Proposal. 
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1.  AN/AAQ-9  PAVE  TACK  FUR 


The  FUR  sensor  Is  an  analog  TV  compatible  sensor  which  Is  sensitive  In 
the  8-14  micron  spectral  band  (l.e.,  passive  Infrared).  The  data  Is  In  the  form 
of  conventional  video,  presented  at  60  flelds/second  Interlaced  to  give  30 
frames/second.  The  FUR  data  Is  available  in  either  525  line  or  875  line 
resolution.  The  required  bandwidth  of  the  current  FUR  sensor  Is  determined  by 
the  IR  detector  resolution.  The  actual  required  data  rate,  however.  Is  determined 
by  the  number  of  successive  frames  of  video  data  which  must  be  examined  to  perform 
the  auto  cuelng/autodetectlon  of  targets.  Current  detector  resolution  and  sensor 
operation  mode  Indicate  a  maximum  effective  data  rate  of  up  to  28.8 
megasamples/sec.  This  can  be  reduced  further  by  examining  the  actual  required 
scene  "update"  rate. 

The  data  format  for  the  conventional  video  form  of  the  FUR  sensor  Is 
shown  in  Figure  3.  The  sensor  characteristics  (l.e.,  resolution,  field  of  view, 
data  rates  and  frame  sizes)  are  shown  In  Table  1. 

Also  available  on  separate  channels  will  be  the  positional  Information 
derived  from  the  ARM-101  system  or  the  LORAN-D  time  difference  Information  which 
can  be  used  to  determine  geographical  location  of  targets.  The  ability  to  convert 
and  display  the  geographical  location  of  targets  will  exist  as  part  of  the  System 
Control  Module  (SCM)  Software. 

2.  AN/AAO-5  OUR 

The  OUR  AN/AAO-5  Is  a  high  resolution  down-looking  IR  sensor  whose 
bandwidth  Is  controlled  by  the  aircraft  V/H  ratio.  The  sensor  consists  of  12 
paralleled,  overlapping  channels,  each  with  a  bandwidth  of  1.2  Megahertz  (MHz). 

The  channels  are  utilized  In  such  a  manner  that  as  the  V/H  factor  Increases, 
additional  channels  are  engaged  to  assure  overlapping  coverage  of  the  ground 
swath.  Thus,  with  all  12  channels  providing  data  In  parallel,  the  equivalent 
bandwidth  Is  18  MHz.  This  dictates  a  Nyqulst  sampling  rate  of  36 
megasamples/sec.  However,  the  method  with  which  the  multiple  channels  are  time 
multiplexed  for  recording  on  the  RCA  Advisor  62A  tape  recorder  reduces  the  actual 
bandwidth  of  each  channel  to  1.0  Megahertz.  This  reduction  In  channel  bandwidth 
results  In  the  reduction  of  the  required  sample  rates. 
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Figure  3.  FUR  Composite  Waveform 


Table  1.  FLIP  Data  Rate  Characteristics 


Six  channels  of  the  AN/AAD-5  are  recorded  sequentially  on  the 
recorder.  Channels  4, 5, 6, 7,8,  and  9  are  recorded  with  the  format  shown  in 
Figure  4. 

THE  NOMINAL*  OUR  TIMING  CHARACTERISTICS  ARE  AS  FOLLOWS: 


LINE  RATE 

PER  100* 

TONE 

DATA 

VIDEO 

IDLE* 

MOOE 

LINES/SEC 

SEC 

SEC 

SEC 

SEC 

SEC 

WFOV 

2400 

416.66 

26.88 

33.6 

350.0 

6.19 

NFOV 

1200 

833.33 

53.76 

62.7 

700.0 

12.37 

*  CHANGES  WITH  ROLL 

The  tone  burst  Is  4, 

761,905  HZ 

1  5 

PPM.  A 

second 

tone,  equal 

in 

amplitude,  exists 

at  595,238  Hz 

.  The  digital 

data  Is 

in  NRZ 

format.  The  first 

word  In  channel  4 

is  a  13  bit  barker  code 

(If 

i nverted 

It  means  that  the 

next  word 

of  the  ADAS  is  the  first  In  the  block).  ADAS  will  occur  over  approx  4  scans.  The 
ADAS  is  comprised  of  ninety-six  (96)  six  bit  words  for  a  total  of  576  bits.  Each 
word  consists  of  one  identification  bit  In  the  first  position,  four  data  bits 
coded  in  excess  three  binary  coded  decimal  plus  one  parity  bit.  The  data  matrix 
coding  is  specified  In  specification  MIL-STD-820,  and  Is  shown  In  Figure  5. 

Three  types  of  rectification  will  be  provided  by  the  SIM  for  the 
AN/AAD-5  sensor  data.  These  include: 

1.  Pixel  skew  -  The  adjacent  channels  of  the  AN/AAO-5  sensor  are  off 
set  and  will  be  realigned  In  the  SIM  by  regeneration  of  line  sync. 

2.  V/H  Overlap  -  At  V/H  crossover  points  (l.e.,  when  addition  of 
channels  are  enabled)  complete  overlap  of  terrain  coverage  exists. 
The  V/H  values  will  be  read  and  a  determination  made  In  real  time 
to  keep  all  data  or  to  drop  alternate  lines  to  avoid  processing 
redundant  data. 

3.  Crosstrack  geometric  warp  -  The  geometric  distortion  Introduced  by 
the  AN/AAD-5  crosstrack  scan  Is  shown  In  Figure  6.  This  distortion 
will  be  corrected  using  look-up  table  techniques  implemented  in  the 
format  generator  of  the  SIM.  Given  a  particular  pixel,  and  the 
aircraft  roll  angle  the  associated  correction  factor  is  aaoressed 
In  the  look-up  table.  The  values  loaded  Into  the  look-up  table  are 
calculated  during  pre-mission  configuration  and  oown-loaded  to  the 
SIM  for  the  particular  sensor  type. 
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Figure  5.  ADAS  Binary  Data  Block 
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Figure  6.  AN/AAC-5  OUR  Sensor  Image  Distortion  Characteristics 
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The  DLIR  AN/AAD-5  sensor  data  rate  characteristics  are  summarized  in 

Table  2. 

3.  Electronic  Solid  State  Wide  Angle  Camera  System  (ESSWACS) 

The  airborne  sensor  employs  140  degree  ground  swath.  Resolution  from 

1000  feet  in  a  push  broom  mode  is  0.75  foot.  This  corresponds  to  5210  feet  of 

ground  coverage  with  a  ground  resolution  of  1.5  ft/ 1 p  when  flying  at  an  altitude 
of  1000  feet  and  at  480  knots  (Mach  0.8).  Data  from  the  five  arrays  and 
synchronization,  V/H  and  roll  data  are  multiplexed  into  a  single  data  line  for 
airborne  storage  or  direct  transmission  to  the  ground.  To  achieve  the  desired 
resolution,  8640  elements  (five  1728  element  arrays)  are  used.  These  arrays  are 
read  at  a  10.5  megasamples/second  (MS/s)  rate  corresponding  to  a  1081  scan/sec 
line  rate.  The  data  from  the  five  arrays  is  time  division  multiplexed  to  a  common 

data  line  by  array  block;  synchronization  Information  and  V/H  and  roll  data  are 

interleaved  in  the  data  stream  as  shown  in  Figure  7. 
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Figure  7.  Composite  Video  Signal 


The  ground  coverage  of  the  ESSWACS  sensor  is  provided  as  shown  in 

Figure  8. 
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Figure  8.  System  Coverage 
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Table  2 


DIIR  Sensor  Characteristics 


Information  Provided  With 
Technical  Proposal 


The  tilted  lens  system  of  Figure  8  introduces  the  image  distortion 
shown  in  Figure  9. 
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Figure  9.  Image  Distortion  Characteristics 

To  provide  a  configuration  easily  modified  to  accept  future  data, 
additional  sensors  have  been  investigated.  These  include: 

1.  Long  Range  Electro-Optical  Reconnaissance  System  (LOREORS)  - 
Another  sensor  which  might  be  considered  is  the  Long  Range 
Electro-Optical  Reconnaissance  System,  a  single-frame  vIsiDle 
scanner.  This  sensor,  like  the  ESSWACS  sensor,  utilizes  multiple 
integrated  CCD  arrays.  Eighteen  64  x  1024  CCD  array,  provide  an 
18,432  pixel/line  x  13,563  line/frame  Image  at  a  10  second/frame 
rate.  The  LOREORS  sensor  was  not  identified  in  the  SOW  but  has 
been  considered  in  the  definition  of  the  system  configuration  to 
provide  maximum  system  flexibility. 

2.  Future  FLIR  sensors  -  These  Improved  sensors  will  encompass 
Improved  performance  over  the  current  FLIR  sensors,  but  should  not 
Impact  the  SIM  configuration. 

3.  Future  Downward  Looking  Infrared  (OLIR)  -  Future  DLIR  sensors  will 
likely  be  IR  versions  of  the  ESSWACS  (visible)  sensor.  The  ESSWACS 
sensor  Is  a  down  looking,  push  broom-type  charge-coupled  device 
(CCD)  sensor  composed  of  five  ,728  element  arrays  which  are  read  at 
a  10.5  Megasamples/ second  rate. 
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System  Throughput  Delay  Considerations 

The  maximum  tolerable  time  delay  associated  with  DHRS-assIsted  Image 
exploitation  Is  specified  as  10  minutes,  with  a  design  goal  of  5  minutes. 

For  the  purposes  of  this  discussion,  DHRS  throughput  delay  Is  defined 
so  as  to  exclude  the  time  required  by  the  human  operator,  l.e.,  the  I/I,  to 
evaluate/verify/correct  or  otherwise  exploit  the  displayed  Imagery.  Our  real 
concern  here  Is  only  with  the  delay  associated  with  the  DHRS  hardware  and 
software.  For  missions  containing  many  target  frames  It  Is  expected  that  the 
overall  exploitation  delay  using  the  Harrls/WEC  baseline  will  be  due  almost  wholly 
to  the  human  operator. 

It  is  readily  established  that  time  delay  associated  with  the  data 
recording  and  playback  function  of  the  SRM  is  the  dominant  machine-related 
contributor  to  DHRS  throughput  delay  for  the  Harris/WEC  baseline.  This  Is  because 
of  the  poor  random-access  time  of  the  only  viable  storage  medium,  magnetic  tape. 
(Magnetic  tape  is  the  only  medium  that  can  cost-effectively  meet  the  10^ 
storage  requirement  and  the  5-mlnute  frame  retrieval  design  goal.)  The  impact  of 
using  image  compression  upon  system  throughput  delay  Is  briefly  discussed  In  this 
subsection.  The  relationship  between  mission  length  and  random  frame  retrieval 
time  is  illustrated  and  the  effect  of  nonreal-tlme  screening  upon  system 
throughput  delay  Is  then  described.  Note  that  the  WEC  screener  Is  a  real-time 
machine. 

Simple  calculations  show  that  the  image  throughput  delays  associated  In 
the  SIM,  RTPM,  and  NRTEM  are  all  well  under  two  seconds  for  either  FLIR  or  DLIR 
imagery;  thus,  only  the  considerably  longer  delay  associated  with  the  S/RM  will  be 
considered  further. 

Recall  that  In  the  assumed  typical  mission  scenario  the  sensor  visits 
four  target  sites.  At  each  target  site  the  pilot  turns  on  the  sensor  somewhat 
prior  to  encountering  the  target  and  turns  off  the  sensor  sometime  Just  after 
leaving  the  target.  The  four-target  mission  scenario  will  yield  a  mission  data 
record  with  target  Information  located  as  shown  In  Figure  10. 


Recall  that  the  target  frames  are  assumed  to  be  located  at  the  center 
of  each  30  second  segment  of  the  mission  data.  The  computations  in  the  figure 
show  that  the  design  goal  specification  of  5  minutes  for  throughput  delay  between 
Ingest  of  the  first  target  frame  and  display  of  at  first  target  frame  can  be  met 
for  mission  lengths  of  2.85  minutes.  Recall  that  the  assumed  mission  length  Is 
two  minutes.  It  should  be  pointed  out  that  the  permissible  mission  lengths 
Increase  significantly  If  throughput  delay  Is  Interpreted  as  being  the  Interval 
between  ingest  of  the  first  target  frame  and  the  first  display  of  any  target 
frame.  This  latter  Interpretation  seems  to  be  more  reasonable. 


Image  Data  Compression  Impacts 


Compression  of  the  input  Imagery  data  will  impact  several  constraints 
of  the  Oata  Handling  and  Recording  System  (DHRS).  Among  these  are: 


1.  Mass  Storage  Capacity 

2.  Mass  Storage  Access  Latency 

3.  Mass  Storage  Spooling  Rates 

4.  Sub  Frame  Address  Generation 


Entropy  reducing  techniques  introduce  significant  Image  degradation  to 
achieve  increased  compression. 


Entropy-preserving  techniques  produce  variable  length  codes,  which 
necessitate  variable  data  rates,  huge  buffers,  or  variable  file  size  for  image 
storage. 


Image  compression  is  only  feasible  for  reduction  of  the  requi.ed  mass 
storage  capacity.  Clearly,  the  random  access  of  compressed  data  from  the 
high-speed  store  Is  not  practical  since  each  access  would  require  a  "back-track" 
through  memory  to  facilitate  decoding.  The  use  of  entropy-preserving  codes  would 
compound  the  problem  since  the  exact  memory  location  of  each  pixel  value  Is 
Indeterminate.  The  necessity  to  channelize  the  processor  pipeline  to  facilitate 
growth  potential  and  flexibility  eliminates  any  compression  technique  which 
utilizes  an  "Intelligent"  search  of  the  high-speed  store. 


The  variable  record  length  creates  software  problems  In  retrieval  of  a 
requested  file,  since  exact  location  of  any  particular  file  is  Indeterminate. 

This  Indeterminancy  means  that  meeting  the  5  minute  random  frame  retrieval  goal 
could  not  be  guaranteed.  In  the  front  end,  access  times  are  critical  and  an 
extensive  record  search  would  violate  data  retrieval  time  constraints.  The 
records  must  be  easily  located,  requiring  constant  record  length  and  simple  file 
search  algorithms. 

After  thoroughly  investigating  several  techniques  from  each  of  the  two 
compression  categories  and  evaluating  the  constraints  necessarily  dictated  by  the 
implementation  of  each,  it  was  decided  that  conventional  data  compression  schemes 
seriously  impact  hardware  and  software  management  of  the  S/RM.  The  attainable 
compression  ratios  do  not  significantly  reduce  the  total  on-line  capacity  of  the 
S/RM  and  do  significantly  impact  access/retrieval  timelines  and  the  software  data 
base  management  problem.  Therefore,  Image  bandwidth  compression  Is  Inappropriate 
for  DHRS. 

The  Throughput  Delay  Impact  of  a  Single-Pass  DHRS  Approach  Using  a 

Nonreal-TIme  Classifier 

A  single-pass  DHRS  approach  using  a  nonreal-time  classifier  requires 
ping  pong  recorders  in  the  S/RM.  In  addition  to  the  expense  associated  with  the 
added  recorder,  there  is  a  serious  operational  implication  of  using  ping  pong  tape 
recorders  with  a  one  pass  nonreal-time  classifier  approach.  This  problem  is 
illustrated  In  Figure  11;  it  might  be  referred  to  as  "ping  pong  runaway".  The 
figure  shows  the  time  location  and  duration  of  the  recording  operation  for  each  of 
the  tapes,  A  and  B.  While  one  tape  Is  recording  the  other  tape  is  playing  back 
Images  at  reduced  speed  Into  the  nonreal-time  classifier.  The  figure  reflects  the 
following  two  assumptions: 

(1)  no  "fast"  rewind  exists  for  the  very  high  speed  tape  recorders 
required  In  DHRS  —  must  rewind  at  normal  speed. 

(2)  the  target  classifier  operates  at  one-half  real  time,  l.e..  It 
takes  the  target  classifier  two  seconds  to  operate  on  one  seconds' 
worth  of  real-time  data. 
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Referring  to  the  tabulated  record  times  for  each  recorder  In  Figure  11  it  may  be 
concluded  that  the  record  and  playback  time  intervals  Increase  exponentially,  and 
that  for  relatively  long  missions  the  nonreal-tlme  exploitation  delay  goal  of  five 
minutes  is  unattainable.  The  problem  is  worse  for  slower  classifiers. 

The  Disadvantage  of  a  Two-Pass  OHRS  Approach  Using  a  Nonreal-Time 

Classif^eT 

The  Harrls/WEC  baseline  OHRS  Is  a  two-pass  approach  using  a  real-time 
classifier  on  the  Imagery  data  during  the  first  pass.  A  nonreal-tlme  classifier 
requires  that  the  Image  data  be  simply  recorded  on  the  first  pass  and  then  played 
back  at  a  slower  rate  into  the  nonreal-time  classifier  during  the  second  pass. 
Since  no  fast  rewind  capability  Is  available  on  the  very  high  speed  tape 
recorders,  the  Images  are  played  back  backwards  in  the  second  pass  to  save  time. 
The  disadvantage  of  using  a  nonreal-time  classifier  in  a  two  pass  approach  is 
illustrated  in  Figure  12.  In  the  figure  the  "x"  corresponds  to  the  first  target 
encountered  during  the  mission.  The  (l/()  in  the  figure  is  the  expansion  factor 
associated  with  the  reduced-speed  playback  into  the  classifier,  where 

(  ,  maximum  detection/classification  rate 
real  time  rate 

The  specific  example  shown  in  Figure  12  illustrates  the  case  of  a  2.5  minute 
mission  duration  and  a  5:1  expansion  factor;  the  result  is  that  there  is  a  15 
minute  delay  to  exploit  the  first  target  frame.  Figure  13  shows  exploitation 
delay  versus  mission  length  with  {  as  a  parameter.  This  figure  shows  that  even 
for  (  *  1/2  the  exploitation  delay  exceeds  the  5  minute  design  goal  if  mission 
length  exceeds  2  minutes. 

System  FAR  Impact  Upon  Throughput  Delay 


A  system  false  alarm  occurs  when  an  image  frame  not  containing  »  target 
is  automatically  displayed  to  the  I/I.  This  can  only  occur  if  the  target  screener 
within  the  RTPM  false  alarms  and  the  RTPM  erroneously  reports  to  the  NRTEM  that  a 
target  exists  within  a  frame  that  contains  no  targets. 
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The  false  alarm  rate  (FAR)  Is  a  very  Important  system  parameter  since 
the  system  throughput  delay  can  be  seriously  degraded  If  the  FAR  Is  sufficiently 
high.  In  order  to  derive  the  maximum  tolerable  FAR  for  the  RTPM  two  assumptions 
are  required  regarding: 

(1)  False  alarm  dismissal  time  -  the  time  required  for  the  Image 
Interpreter  to  dismiss  a  displayed  Image  that  does  not  contain  a 
target . 

(2)  The  total  time  allocated  per  mission  for  the  operator  to  dismiss 
false  alarms. 

The  maximum  tolerable  FAR  may  then  be  determined  as  follows: 

far  *  total  time  allocated  for  dismissing  false  alarms 

*  (total  number  of  frames) (false  alarm  dismissal  time  per  frame) 

Human  Operator  Throughput  Delay 

The  amount  of  time  the  Image  interpreter  devotes  to  a  displayed  target 
frame  depends  upon  many  factors: 

(1)  Number  of  targets 

(2)  Size  of  targets 

(3)  Distribution  of  target  types 

(4)  Number  of  misclassifled,  unclassified  or  undetected  targets  In  the 
frame 

(5)  Quality  of  target  Images:  SNR,  contrast  ratio,  thermal  noise, 
time-of-day,  sun-angle,  local  weather  at  tlme-of -mission 

(6)  Skill  of  Image  Interpreter 

(7)  Urgency  of  mission 

(8)  Prior  knowledge  regarding  geography,  expected  targets,  etc. 


In  view  of  the  large  number  of  factors  affecting  the  required  display  time  of  an 
image  It  Is  difficult  to  estimate  It;  only  experience  gained  from  operation  of  the 
DHRS  with  typical  Input  tapes  will  be  useful  In  predicting  the  system  throughput 
delay  due  to  the  human  operator  (I /I). 


In  this  subsection  a  discussion  of  the  performance  of  the  Westinghouse 
AUTO-Q  system  In  relation  to  such  key  parameters  as  video  signal-to-noise  ratio, 
target  size  in  resolution  elements,  and  system  sensitivity  threshold  is 
presented.  This  performance  evaluation  is  facilitated  by  a  comparison  of  the 
AUTO-Q  performance  with  human  detection  performance. 


A  comparison  of  human  and  machine  recognition  of  rectangles  imbedded  in 
noisy  backgrounds  as  a  function  of  video  SNR  has  been  conducted.  The  test  Images 
are  shown  in  Figure  14(a).  Nine  rectangles  are  shown  here,  each  of  which  must  be 
recognized  by  shape,  and  discriminated  from  the  noise  background.  The  human  is 
presented  with  an  analogous  situation,  presented  by  a  TV  display,  as  described  in 
the  reference.  A  comparison  of  AUTO-Q  and  human  performance  for  this  test  is 
shown  by  Figure  14(b). 


At  the  low  signal-to-noise  values,  the  machine  performance  approaches 
human  performance  within  the  95  percent  confidence  intervals  of  the  experiment. 
Such  high  noise  conditions  are  probably  typical  of  much  FlIR  Imagery. 

Furthermore,  the  human  performance  measured  in  the  laboratory  can  be  expected  to 
deteriorate  in  an  aircraft  cockpit.  Thus,  one  can  reasonably  argue  that 
recognition  machines  can  compete  favorably  with  humans  under  difficult  conditions. 


For  signal-to-noise  ratios  above  0.9,  the  probability  of  detection  for 
the  rectangle  exceeds  90  percent.  Thus,  the  performance  requirements  of  the  SOW 
can  be  met  if  an  adequate  signal-to-noise  ratio  exists. 


Every  recognition  system  offers  a  tradeoff  between  detection 
probability  and  false  alarm  rate,  as  determined  by  a  detection  threshold,  For  the 
same  test  data  used  In  obtaining  Figure  14(b)  these  tradeoffs  are  shown  as  a 
function  of  signal-to-nolse  ratio  In  Figure  15.  Note  that  with  a  threshold  of  17 
or  greater,  and  a  zero  false  alarm  rate,  the  detection  probability  approaches  89 
percent  for  very  high  S/N.  On  the  other  hand,  with  a  threshold  of  6  or  greater, 
and  a  7.4  percent  false  alarm  rate,  the  detection  probability  approaches  100 
percent.  Clearly,  high  detection  (or  recognition)  probabilities  can  be  associated 
most  readily  with  low  false  alarm  rates  when  the  signal-to-noise  ratios  are  high. 


Detection  of  Rectangles  by  Auto- 
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Figure  14.  Detection  of  Rectangles  by  AUTO-Q 


0  25 


075  10 


Figure  15 


0  5 

1 

VIDEO  S/N 

7 9  0345- V -4  7 


.  Effect  of  Detection  Threshold  on  Performance 


It  is  well  known  that  recognition  performance  depends  on  the  target 
size  in  resolution  elements.  A  variety  of  experience  on  this  subject  is 
summarized  in  Figure  16.  The  well-known  Johnson  criteria  for  human  detection, 
recognition,  and  identification  at  the  50  percent  probability  level  are  shown, 
together  with  hunan  experience  with  various  military  targets.  In  addition,  curves 
for  detection,  acquisition,  and  classification  have  been  added  from  the  AUTO-Q 
test  data  from  the  Army  programs.  Acquisition  is  defined  by  the  screening  of 
detected  target  samples  by  size  and  shape  so  as  to  improve  the  probability  of  their 
Inclusion  in  the  full  set  of  target  classes.  Both  the  acquisition  and 
classification  probabilities  relate  to  the  original  number  of  test  samples 
involved;  the  values  would  be  higher  if  they  related  Instead  to  the  number  of 
samples  detected.  In  any  case,  it  is  apparent  that  the  90  percent  probability 
will  be  reached  for  detection,  and  80  percent  probability  for  classification  as 
image  resolution  is  increased. 

A  final  comparison  is  made  in  Figure  17  between  AUTO-Q  performance  on 
the  synthetic  imagery  of  Figure  14  and  on  the  real  FlIR  imagery  of  Figure  16  for 
three  levels  of  system  sensitivity.  The  similarity  between  these  curves  suggests 
that  the  WEC  understanding  of  AUTO-Q  performance  is  valid. 

From  the  foregoing  discussion  it  may  be  concluded  that  the  design  goals 
of  the  SOW  can  be  met  under  favorable  conditions  of  slgnal-to-noise  ratio, 
sensitivity  threshold,  and  target  size  in  resolution  elements.  Further  discussion 
on  each  of  the  detailed  requirements  now  follows. 

The  WEC  AUTO-Q  will  offer  specified  performance  in  target  detection, 
classification,  and  misclassificatlon.  The  WEC  response  to  each  of  the 
performance  guidelines  is  as  follows: 

a.  Use  of  Range  Data  or  Other  Aids 

Westlnghouse  has  completed  statistical  performance  tests  of 
autoscreening  on  FLIR  Imagery  both  with  and  without  the 
availability  of  range  Information.  In  the  laboratory  breadboard 
systems  described  elsewhere,  the  use  of  the  range  Information  is  an 
option.  In  the  following  discussion  It  will  be  assumed  that  range 
information  is  not  available. 
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Figure  16.  Comparison  of  AUTO-Q  Performance  to  Human  Observer 
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Figure  17.  Comparison  of  AUTO-Q  Performance  on  Synthetic  Imagery 

and  Real  FLIR  Imagery 


b.  Target  Detection 

Detection  of  targets  with  the  AUTO-Q  system  has  consistently 
exceeded  90  percent.  Third  generation  improvements  in  our 
preprocessor  (in  gradient  tracking  and  the  addition  of  level 
slicing)  will  improve  this  figure.  We  have  dealt  with  a  wide 
variety  of  vehicular  targets.  Including  Russian  and  Chinese  tanks 
and  APC's.  Our  videotape  data  base  exceeds  70  hours  of  recording 
on  tactical  scenes. 

c.  Target  Classification 

Westlnghouse  feels  that  the  prospects  for  meeting  the  80  percent 
design  goal  are  good,  based  upon  earlier  performance  and  with  the 
addition  of  the  Improvements  to  be  discussed  below.  We  note  that 
for  the  statistical  performance  tests  for  the  Army  correct 
classification  was  in  the  range  of  50  to  65  percent,  with  four 
target  classes,  and  40  to  70  percent,  for  three  classes, 
respectively. 

How  will  we  make  an  improvement  from  the  60  percent  range  with  four 
target  classes  to  the  80  percent  range  with  8  classes?  The  answer  lies  with 
improved  FLIR  imagery,  with  improved  processing  techniques,  and  with  improved 
decision  logic.  Imagery  used  for  the  Frankford  Arsenal  tests  was  obtained  by 
making  16-mm  films  of  the  AN/AAQ-5  display.  The  resulting  imagery  was  heavily 
degraded  in  both  resolution  and  available  gray  scale  range.  Imagery  used  for  the 
NVL  tests  was  affected  enough  by  processing  artifacts  (noise  and  ripple)  to  reduce 
the  corresponding  human  performance  to  about  50  percent.  In  this  test  it  was 
found  that  machine  performance  slightly  exceeded  the  human  performance  for  the 
same  data  set.  Therefore,  if  the  data  set  permits  80  percent  human  response,  we 
expect  AUTO-Q  to  exceed  this  value. 

Recent  hardware  developments  provide  an  all-digital  system,  replacing 
an  earlier  analog  scan  converter  in  our  original  AUTO-Q  breadboard.  In  addition, 
preprocessing  operations  have  been  Improved  at  every  stage. 

Finally,  we  expect  performance  Imp-ovement  associated  with  the 
classification  logic.  This  will  be  obtained  by  an  increased  reliance  on 
syntactical  target  descriptions.  The  AUTO-Q  system  Is  inherently  syntactical  in 
nature,  but  in  earlier  tests  with  low-quality  imagery,  application  of  this  feature 
was  limited. 


37 


For  the  larger  targets,  such  as  SAM  sites,  syntactical  recognition 
techniques  are  particularly  appropriate,  as  well  as  the  use  of  context  and 
textural  clues. 


d.  Mlsclassification  and  Nonclassification 

The  specified  mi sclassifl cation  design  goal  is  10  percent.  Since 
the  specified  correct  classification  design  goal  is  80  percent,  the 
permissible  rate  of  nonclassification  Is  10  percent. 

Nonclassification  occurs  when  a  defected  target  cannot  be  placed  In  any  of  the 
available  target  type  classification  categories;  such  targets  must  be  classified 
by  the  human  operator. 

e.  Classification  and  Feature  Measurement  Modules  for  NRTEM  (SOW 
Paragraph  4.1.1 .4.8) 

AUTO-Q  can  provide  the  required  feature  measurements  for  such 
modules  as  an  output  from  the  RPTM  if  desired.  Measurements  such 
as  shape,  area,  size,  texture  radiance,  and  reflectance  are 
routinely  obtained  in  vector  form  by  AUTO-Q  for  use  in 
classification  of  targets,  or  for  discrimination  between  man-made 
and  natural  features. 

Computationally  Intensive  OHRS  Functions 

Two  of  the  required  OHRS  functions,  rectification  and  target  coordinate 
calculation,  are  computationally  intensive  and  are  therefore  briefly  discussed 
here. 

1.  LOR AN  (D)  Navigation  System 

The  LORAN  (D)  Navigation  System  Is  a  highly  accurate  pulsed  hyperbolic 
navigation  system  similar  to  and  compatible  with  LORAN  (C).  It  is  designed  for 
military  tactical  use.  This  discussion  will  explain  the  considerations  of  using 
LORAN  with  Image  systems  where  the  LORAN  data  Is  Imposed  upon  the  frames  of  image 
data.  First,  a  short  discussion  of  conventional  LORAN  systems  and  receivers  is 
presented.  The  LORAN  System  consists  of  master  and  slave  transmitting  stations 
each  separated  geographically.  All  of  the  stations  transmit  on  precisely  the  same 
frequency  (100  kH2)  but  they  are  skewed  In  time;  i.e.,  the  master  transmits  a 
burst,  then  Slave  1  transmit  a  burst,  then  Slave  2,  etc.  The  user  knows  the  exact 
location  of  the  master  and  slaves.  He  also  knows  the  exact  time  delay  between  the 
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master  transmit  time  and  each  slave  transmit  time.  The  receiver  measures  the 
receive  time  difference  between  the  master  and  each  slave.  This  time  difference 
remains  constant  as  long  as  the  receiver  is  not  moving.  The  locus  of  points  in 
which  the  difference  is  constant  from  2  points  (master  and  1  slave)  describes  a 
hyperbola.  To  find  the  user  location,  the  equipment  measures  2  time  differences 
thereby  describing  2  hyperbolas  and  then  intersects  the  curves.  In  the  general 
case,  there  could  be  many  intersections  of  two  curves  (each  hyperbola  has  2 
distinct  sections)  but  the  geographic  location  of  the  master  and  slaves  allows 
only  1  intersection  over  coastal  waters. 

The  tasks  that  must  be  performed  to  derive  position  are  listed  below: 

1.  Determine  which  station  is  master  (done  by  group  repetition  rate) 

2.  Determine  which  slaves  are  being  received 

3.  Measure  2  time  differences 

4.  Intersect  hyperbolas 

5.  Translate  time  location  to  desired  coordinates  (UTM;  lat/long;  etc.) 

One  of  the  main  problems  arises  with  the  measurement  of  the  time 
differences.  Noise  corrupts  the  measurement  of  time  in  both  the  start  and  stop 
directions.  To  eliminate  erroneous  readings,  conventional  receivers  use  Kalman 
filters  to  average  the  time  differences,  eliminating  the  noise.  A  number  of 
points  taken  in  the  averaqe  depend  on  the  quality  of  the  rejection  of  the  100  kHz 
receivers;  the  number  and  types  of  noise  sources,  the  distance  from  the  receivers, 
and  other  factors.  The  Coast  Guard  has  put  an  upper  limit  of  20  minutes  for 
lockout.  This  corresponds  to  approximately  12,000  sample  time  differences  at 
worst  case. 


The  image  segment  in  the  DHRS  can  vary  from  30  seconds  to  2  minutes; 
therefore,  the  number  of  samples  ranges  from  300  to  1200.  If  the  samples  are  raw; 
i.e.,  not  averaged,  then  just  these  samples  alone  would  generally  not  be 
sufficient  to  eliminate  the  noise  factor  via  Kalman  filtering.  If  the  receiver 
was  the  averaging  type  (i.e.,  ARM- 101)  and  assuming  it  had  been  on  for 
considerable  length  of  time  (  5  min)  then  use  of  the  last  300-1200  samples  could 
be  used  to  calculate  position.  The  master  and  each  slave  would  have  to  be 
identified  with  each  time  difference.  Usually  this  is  the  case  because  the 
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interpreter  knows  what  section  of  the  world  the  image  was  taken  in.  To  complicate 
matters,  the  image  in  question  would  be  taken  from  a  high  speed  aircraft.  This 
means  that  not  only  time  differences  would  have  to  be  averaged  but  also  bearing, 
velocity  and  altitude.  The  total  number  of  sample  points  given  with  the  Image 
frames  are  not  sufficient  to  average  out  the  noise.  These  points  must  be  averaged 
onboard  the  aircraft. 

Calculating  the  Intersection  of  the  two  hyperbolas  and  translating  to 
correct  coordinates  is  straightforward  and  should  take  about  20  milliseconds  of 
CPU  time  (100K  Instructions  at  250K  instructions/sec)  in  the  SCP. 

Assuming  that  an  onboard  navigation  system  Kalman  filters  the  required 
parameters,  the  CPU  time  to  calculate  the  image  position  should  be  about  20 
mi lliseconds.  If  the  parameters  are  not  filtered,  then  the  data  available  (on  the 
video  tape)  to  the  ground  processing  system  is  Insufficient  to  calculate  the 
position  within  any  reasonable  accuracy.  This  constraint  should  be  included  with 
any  accuracy  requirements  in  target  location. 

To  improve  location  accuracy,  eliminate  the  noise  problem,  and  reduce 
calculation  processing  time,  the  DHRS  could  utilize  the  Global  Positioning  System 
(GPS)  currently  being  implemented.  The  GPS  will  provide  positional  data  by  the 
time  field  deployable  DHRS  installations  are  a  reality.  Harris  GCSD  Is  actively 
involved  in  the  GPS  network  development.  The  DHRS  can  be  easily  modified  to 
accept  and  utilize  GPS  data  as  opposed  to  the  less  accurate  LORAN  (0)  data. 

2.  Image  Rectification 

In  this  section  image  rectification  is  defined  and  the  purpose  of 
performing  image  rectification  is  discussed.  The  DLIR  and  FLIR  Image 
rectification  geometry  is  described  and  the  corresponding  rectification  algorithms 
are  briefly  discussed.  A  considerably  more  detailed  treatment  of  the  DLIR  and 
FLIR  rectification  techniques  is  contained  In  Appendix  6.1.1  of  the  Technical 
Proposal . 
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When  the  Image  pixels  from  the  Pave  Tack  FlIR  or  AN/AAD-5  DLIR  sensors 
are  displayed  on  a  CRT  without  processing  the  displayed  image  does  not  exhibit 
uniform  scale  throughput  the  image.  This  is  a  result  of  the  fact  that  sensor 
output  samples  that  are  uniformly  spaced  in  time  correspond  to  earth  plane  samples 
that  are  nonuni formly  distributed  in  space.  After  rectification  the  displayed 
image  exhibits  uniform  scale  in  both  dimensions  throughout  the  image. 

In  normal  DHRS  operation,  FLIR  rectification  will  not  be  employed; 
however,  at  the  DHRS  operator's  option,  image  rectification  can  be  performed  on  a 
FLIR  image.  DLIR  imagery,  on  the  other  hand,  is  normally  rectified  in  the  SIM 
prior  to  storage,  screening,  or  display.  At  the  DHRS  operator's  option,  DLIR 
imagery  can  be  stored,  screened,  and  stored  in  unrectified  form. 

2a.  DLIR  Image  Rectification 

The  AN/AAD-5  DLIR  sensor  is  a  line-at-a-time,  spinning  mirror  type, 
downward- looking  sensor.  Since  the  aircraft  carrying  the  sensor  is  moving,  the 
DLIR  scan  lines  are  not  orthogonal  to  the  ground  track  flight  path.  Moreover, 
since  the  sensor  sampling  is  equiangular  in  nature  over  a  flat  earth,  the  pixel 
path  in  the  earth  plane  is  not  a  straight  line  but  has  a  slight  curvature.  Figure 
18  shows  that  the  amount  of  curvature  Is  so  slight  as  to  be  completely 
negligible.  Furthermore,  the  deviation  from  orthogonality  between  the  flight  path 
and  the  earth  plane  scan  line  pixel  path  Is  extremely  small,  viz., 

tan"^  a  0.138°  and  may  be  neglected.  Thus,  along-track  correction  or 

rectification  is  not  required  at  all. 

The  across-track  or  along-scan  distortions  are  due  to  equiangular 
sampling  of  the  DLIR  sensor  output  and  are  not  negligible.  The  size,  shape,  and 
along  scan  spacing  of  the  DLIR  earth  plane  pixels  changes  as  a  function  of 
distance  along  scan.  The  nature  and  extent  of  these  changes  are  summarized  in 
Figure  19  for  the  particular  case  of  H  -  200',  V/H  «  5  and  FOV  *  120  .  The  4:1 
growth  of  pixel  spacing  from  nadir  to  end-of-scan  requires  along  scan 
rectification  or  remapping  in  order  to  maintain  uniform  scale  In  the  displayed 
image.  This  rectification  process  is  performed  in  the  SIM  in  real-time  prior  to 
placing  the  DLIR  data  on  the  Image  ingest  bus.  Since  the  image  ingest  bus  feeds 
both  the  RTPM  and  the  S/RM,  the  OLIR  Images  are  stored  in  rectified  form  in  the 
S/RM. 
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This  rectification  process  is  implemented  by  simply  repeating  pixel 
values  as  required  along  scan.  Since  no  resolution  reduction  Is  permitted,  pixel 
deletion  in  the  DIIR  rectification  process  is  not  normally  allowed.  The  SIM 
determines  the  number  of  times  each  pixel  should  be  repeated  by  consulting  a 
look-up  table.  The  raw  DIIR  pixels  may  be  repeated  0,  1,  2,  or  3  times  depending 
upon  the  raw  pixel  position  along  the  sensor  scan.  Since  pixels  can  be  repeated 
only  an  integer  number  of  times  there  will  be  some  local  distortions  In  the 
rectified  DIIR  lines,  but  these  will  not  exceed  one  display  pixel  spacing.  The 
nature  of  the  pixel -repetition  table  is  shown  In  Figure  20. 

The  DLIR  pixels  corresponding  to  a  single  DIIR  scan  will  be  mapped  into 
6  x  1024  *  6144  pixels  after  recti ficatlon  with  the  result  that  the  resulting 
pushbroom-style  rectified  DLIR  imagery  that  is  stored  in  the  S/RM  will  be  six 
display  widths  wide. 

The  user  may  decide  to  rectify  or  not  to  rectify  the  Incoming  data. 

The  result  is  that  the  Full-Frame  Image  Bus  transfer  rate  will  allow  for  higher 
bandwidth  or  wider  dynamic  range  if  rectification  is  not  done  on-the-fly.  Another 
means  of  controlling  data  rate  "expansion"  is  to  use  pixel  deletion  in  the  high 
resolution  area  near  nadir.  Either  method  can  be  accommodated  by  the  look-up 
table  method  of  rectification  utilized  In  the  AN/AAD-5  input  submodule. 

2b.  FLIR  Image  Rectification 

The  FLIR  image  differs  from  the  line-at-a-tlme  image  in  that  FLIR 
frames  may  be  regarded  as  snapshots  of  what  the  FLIR  sensor  sees;  In  other  words, 
the  FLIR  sensor  Images  in  a  frame-at-a-time  fashion  rather  than  in  a 
line-at-a-tlme  fashion.  The  geometrical  distortions  are  much  more  pronounced  than 
in  the  case  of  DLIR  Imagery  since  FLIR  sensor  earth  pixel  ray  paths  are  more 
nearly  parallel  to  the  earth's  surface. 

As  in  the  DLIR  case,  uniformly  spaced  time  samples  yield  earth  plane 
pixels  that  are  not  uniformly  distributed  on  the  earth's  surface.  A  top  view  of 
the  resulting  geometric  distortion  is  shown  In  Figure  21  for  both  B  ro1^  ■  o 
and  0  roll  -0. 
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NUMBER  OF  TIMES  THE 
RAW  PIXEL  IS  REPEATED 


Figure  20.  The  Pixel  Repetition  Function  for  OLIR 
Along-Scan  Rectification 
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Figure  21.  The  Effect  of  Sensor  Roll  Upon  FUR  Image  Shape 
and  Position  the  Earth  Plane 
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Analytical  expressions  for  the  inverse  transformation  equations  for 

^  rol 1  s  0  and  the  equations  governing  FLIR  rectification  forflro11  »  0  are 
available.  The  solutions  to  these  equations  for0rQl1  =  0  must  be  obtained 
using  iterative  techniques.  Once  this  is  done  for  a  sparse  set  of  display  image 
control  points  a  third  order,  two  variable  approximation  to  the  required  inverse 
transformation  can  be  obtained  for  selected  values  of  roll. 
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SUMMARY  OF  RESULTS 


The  functional  description  and  the  described  user  scenario  were  used  to 
define  the  detailed  DHRS. 

The  DHRS  consists  of  several  vendor  supplied  items  integrated  with 
special  purpose  hardware  to  provide  an  efficient  Implementation  of  the  target 
detection/classification/verification  function.  These  vendor  supplied  Items 
include  the  high  density  magnetic  tape  recorder,  the  image  display  console,  the 
voice  recognition  module,  and  the  system  control  processor.  The  RTPM  will  consist 
of  a  combination  of  Harris  and  Westinghouse  technologies  providing  a  real-time 
target  detection/classification  capability.  All  other  functions  will  be 
implemented  in  dedicated  hardware/software  modules  utilizing  existing  Harris 
technologies. 

Each  individual  subsystem  is  discussed  in  detail  in  the  following 

paragraphs. 


The  techniques  utilized  in  the  hardware  developed  by  Harris  have  been 
demonstrated  on  many  previous  programs  requiring  data  management,  variable  data 
rates,  synchronization  and  A/D  conversion,  intelligent  retrieval  techniques  and 
image  enhancement/display. 

DHRS  will  consist  of  four  interconnected  subsystems.  The  data  flow 
among  these  subsystems  and  the  Inputs,  outputs,  and  functions  of  each  of  these 
subsystems  will  be  briefly  described  below.  Following  this  overview  of  DHRS,  the 
interfaces  and  functions  of  the  subsystems  will  be  described  In  more  detail  in 
subsequent  paragraphs.  The  following  acronyms  for  the  four  subsystems  will  be 
used: 


SIM  ■  Sensor  Input  Module 
S/RM  «  Storage  and  Retrieval  Module 
RTPM  »  Real-Time  Processing  Module 
NRTEM  *  Near  Real-Time  Exploitation  Module 
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Figure  22  is  a  top-level  block  diagram  of  the  DHRS  system  which  shows 
how  the  various  subsystems  are  interconnected.  Figure  23  is  a  more  detailed  block 
diagram  of  the  DHRS  system  that  shows  the  constituent  parts  of  each  of  the 
subsystems.  There  are  four  well-defined  functions  performed  within  the  DHRS.  The 
Ingest  function  is  performed  by  the  SIM  module,  the  Storage  and  Retrieval  function 
is  performed  by  the  S/RM  module,  the  Target  Screening  and  Target  Classification 
function  is  performed  by  the  RTPM  module  and  the  interactive  verification  function 
is  performed  within  the  NRTEM  module  by  the  human  operator.  These  four  modules 
are  interconnected  using  a  low-risk  bus  architecture  approach  In  order  to 
accommodate  the  extremely  high  data  rates  Involved.  The  input  to  the  DHRS  system 
consists  of  infrared  imagery  which  is  stored  on  analog  video  tape  using  an  RCA 
Advisor  62  video  tape  recorder.  There  are  presently  three  input  data  types  of 
interest:  525  line  FUR,  875  line  FUR  and  AN/AAD-5  DUR. 

The  data  flow  in  the  DHRS  is  best  understood  by  referring  to  Figure 
23.  The  SIM  subsystem  converts  the  analog  input  data  into  digital  form  and  routes 
it  to  the  Storage  and  Retrieval  Module  and  also  to  the  Real-Time  Processing  Module. 

The  Storage  and  Retrieval  Module  performs  two  functions.  It  provides 
an  archival  long-term  storage  capability  and  also  permits  the  Interpreter  to 
recall  selected  frames  for  display.  The  Real-Time  Processing  Module  performs  the 
automatic  screening  operation.  The  screening  operation  consists  of  automatically 
examining  input  image  frames,  detecting  any  targets  that  exist  within  the  frame, 
and  classifying  the  targets  that  ’•e  detected  according  to  type,  such  as  tank, 
aircraft,  etc.  The  frame  numbers  of  those  frames  containing  targets  are  passed 
from  the  RTPM  to  the  NRTEM  or  verification  subsystem.  This  information  is  then 
used  to  retrieve  the  targeted  frames  from  the  Storage  and  Retrieval  Module.  The 
retrieved  image  frames  are  then  queued  up  In  a  first-ln/f Irst-out  image  frame 
buffer  that  resides  in  the  M1TEM  subsystem.  Using  the  image  display  capabilities 
of  the  NRTEM  subsystem,  the  image  interpreter  then  visually  inspects  the 
classification  results  obtained  by  the  RTPM  screening  subsystem.  For  each  of  the 
targets  Identified  within  the  displayed  image  frame,  the  Image  Interpreter  either 
concurs  with  the  automatic  classification  of  each  target  or  corrects  the 
classification.  If  he  determines  that  It  is  Incorrect.  This  verification  operation 
is  facilitated  by  the  use  of  an  Interactive  voice  Input,  man/machine  Interface. 

The  output  of  the  DHRS  system  is  a  printed  target  report.  This  target  report 
identifies  all  targets  and  gives  Information  regarding  the  location  and  target 
type  of  each  target. 


SYSTEM  CONTROL  BUS 


In  summarizing,  the  overall  operation  of  DHRS,  we  may  say  that  a  very 
large  number  of  input  Image  frames  are  Ingested  into  DHRS  and  that  these  frames 
are  automatically  screened  without  human  intervention  by  the  screening  subsystem. 
The  RTPM  produces  the  target  frame  numbers  and  passes  them  on  to  the  NRTEM.  These 
frame  numbers  are  then  used  to  recall  these  Image  frames  from  the  Storage  and 
Retrieval  Module  for  display  to  the  I/I.  The  I/I  either  concurs  with  or  corrects 
the  classification  decisions  made  by  the  automatic  screener.  The  net  result  of 
this  sequence  of  events  is  that  the  I /I  need  only  examine  those  frames  that  are 
known  to  contain  targets.  The  I/I  does  not  waste  time  looking  at  the  frames  that 
do  not  contain  targets.  The  result  is  that  a  single  Image  Interpreter  can  perform 
the  image  Interpretation  function  for  a  mission  in  a  much  more  timely  fashion  with 
an  accuracy  comparable  to  that  obtained  if  manual  Image  interpretation 
is  used. 


DHRS. 


The  following  paragraphs  will  describe  the  subsystem  functions  of  the 


SIM  Subsystem  (Input  Function) 

The  purpose  of  the  SIM  is  to  condition  and  format  the  Image  data  from 
the  various  input  sensors  so  that  It  can  be  processed  by  the  remainder  of  the 
DHRS.  The  Harris  design  of  the  SIM  is  modular  and  flexible  so  that  It  may  be 
tailored  to  available  sensors  and  easily  expanded  to  accommodate  future  sensors. 
The  SIM  will  consist  of  three  submodules  designed  to  accommodate  the  three  types 
of  sensor  input  data:  525  FLIR,  875  FLIR,  and  DLIR.  A  four  bit  control  message 
from  the  system  controller  is  received  by  the  SIM  that  specifies  which  of  the 
three  sensors  will  be  In  use  for  a  particular  mission.  Figure  24  shows  how  the 
submodules  are  connected  to  a  common  formatter.  Also  shown  are  the  data  flow  and 
control  signals  within  the  SIM.  Sync  signals  and  digital  documentation  data 
signals  are  stripped  off  of  the  input  data  signal  in  each  of  the  SIM  submodules. 
Thus,  the  signal  formatter  within  the  SIM  receives  three  types  of  signals  from 
whichever  submodule  is  in  use:  Sync  Signal,  Digital  Documentation  Data  Signal 
(Navigation  Data),  and  IR  Imagery  Data.  The  output  of  the  SIM  consists  of  IR 
Imagery  data  and  Digital  Documentation  data  which  is  put  onto  a  high-speed 
parallel  bus.  This  Imagery  data  and  documentation  data  is  then  simultaneously 
transmitted  to  both  the  Storage  and  Retrieval  Module  (S/RM)  and  the  Real-Time 
Processing  Module  (RTPM). 
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Figure  24.  Expandable  SIM  Configuration 
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S/RM  Subsystem  (Storage  and  Retrieval  Function) 

The  S/RM  will  provide  two  functions  for  the  DHRS.  It  will  provide  a 
long-term  archival  storage  function  whose  capacity  will  virtually  be  unlimited 
(1011  bits/reel)  and  It  will  also  provide  a  fast  short-term  retrieval  capability 
which  will  be  used  by  the  NRTEM  to  retrieve  and  display  frames  with  targets.  The 
heart  of  the  S/RM  will  feature  a  modular  design  so  that  an  expansion  to  twice  the 
existing  capacity  of  1011  bits  on-line  can  easily  be  accommodated  with  no  impact 
to  the  rest  of  the  system.  The  bus  control ,  search  control ,  bus  select  and 
Storage  and  Retrieval  Module  will  have  the  following  components  as  shown  In  Figure 
25:  Its  own  dedicated  storage  and  retrieval  control  processor,  input  processor, 
subframe  extractors,  decimator,  and  bus  interface.  The  S/RM  control  processor 
will  maintain  the  SIM  Format  Generator,  search  control,  subframe  extraction, 
decimator,  and  bus  interface  functions  of  the  S/RM. 

The  Image  pixels  will  be  represented  by  either  6-bits  or  8-blts  and 
these  pixels  will  be  packed  into  24-bit  words  for  storage  on  and  retrieval  from 
the  tape  recorder.  The  1.2  Megaword/record  format  means  that  five  875-line  FUR 
frames,  fifteen  525-line  FLIR  frames,  or  512  -  6000  pixel  DLIR  Imagery  lines  will 
be  stored  in  one  record.  Auxiliary  tracks  of  the  recorder  contain  record  numbers, 
header  data,  and  sync  Information  in  order  to  facilitate  the  retrieval  process. 
Recall  that  the  S/RM  control  processor,  upon  command  from  the  System  Control 
Processor,  will  control  all  the  details  of  the  data  recording,  retrieval,  subframe 
extraction,  and  bus  interfacing  processes  and  thus  offload  the  system  control 
process . 


The  input  processor  will  unpack  the  video  data  words  from  the  24-bit 
bus,  extract  record  sync,  frame  sync,  field  sync,  and  line  sync,  and  generate  a 
pixel  count  within  each  line  of  Imagery.  The  output  of  the  Input  processor  will 
drive  a  video  and  sync  bus  and  pixel  count  bus  Interfaced  to  each  of  the  six 
subframe  extractors.  The  subframe  extractors  will  select  a  subframe  from  the  OLIR 
data  (or  a  full  FUR  frame)  and  output  the  desired  subframe  (or  frame)  to  the 
subframe  display  bus  via  the  corresponding  bus  Interfaces.  The  decimator  will 
perform  line  and  pixel  averaging  on  the  OLIR  subframes  and  will  output  a  display 
size  OLIR  Image  to  the  subframe  display  bus. 
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The  function  of  the  RTPM  will  be  to  automatically  screen  the  Input 
imagery  data.  Specifically,  frames  containing  targets  will  be  Identified.  These 
targets  within  the  frame  will  be  classified  and  located.  The  RTPM  will  consist  of 
the  three  subfunctions  of  Figure  26.  Frame  Grabber,  Target  Detector,  Target 
Classifier.  In  normal  operation,  frames  of  real-time  FLIR  or  lines  of  real-time 
DLIR  imagery  data  will  be  loaded  via  the  full-frame  message  bus  to  the  frame 
grabber.  The  frame  grabber  will  deliver  one  line  at  a  time  of  the  frame  to  the 
target  detection  function.  The  target  detection  function  will  detect  the  targets 
and  transfer  feature  information  to  the  target  classifier  submodule.  The  target 
classifier  will  classify  each  of  the  detected  targets  as  one  of  a  preselected 
number  of  target  types.  The  target  detection  submodule  and  target  classifier 
submodule  of  Figure  27  will  be  subcontracted  to  Westinghouse  Electric  Corp.  The 
algorithms  for  target  detection  and  target  classification  are  fully  developed  and 
tested  and  the  deliverable  hardware  will  consist  of  a  modification  of  existing 
hardware  developed  at  Westinghouse.  The  Westinghouse  target  detection  and  target 
classification  submodules  will  operate  at  real-time  imagery  rates. 

NRTEM  Subsystem 

The  NRTEM  subfunctions  will  allow  the  operator  to  verify  the  RTPM 
decisions.  The  two  subfunctions  within  the  NRTEM  will  be: 

a.  Image  Processing  and  Display  Control  (IP/DC) 

b.  System  Control  for  the  Overall  DHRS 

The  hardware  that  performs  these  two  subfunctions  will  be  off-the-shelf 
and  vendor  supplied,  with  the  exception  of  some  custom  Interfaces  that  will  be 
required  for  coowunl cations  with  other  modules. 

The  IP/DC  will  contain  the  following  components:  a  display  processor 
for  real-time  Image  enhancement.  Image  display.  Image  queue/refresh  memory  and  a 
display  control  processor  to  provide  ancillary  device  control.  The  architecture 
for  the  IP/DC  Is  shown  In  Figure  28. 


56 


Figure  27.  AUTO-Q  Digital  Image  Processor  -  Block  Olagram 
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Figure  28.  Target  Frame  Queue,  Image  Display  Processing  Portions  of  NRTEM 
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The  System  Control  Module  (SCM)  will  contain  the  following  components: 
system  control  processor  with  necessary  peripherals,  voice  recognition  module,  and 
system  software.  The  SCM  configuration  Is  shown  in  Figure  29. 


SYSTEM  CONTROL  PROCESSOR 

BASELINE  ARCHITECTURE 
HARDWARE  CONFIGURATION 


Figure  29.  System  Control  and  Voice  Input  Portions  of  NRTEM 
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CONCLUSIONS 


The  Harris/WEC  DHRS  baseline  has  the  following  features: 

1 .  Low  Ri sk 

•  WEC  target  screener  developed 

9  Harris  and  WEC  are  stable,  large  corporations  with  existing 
test  facilities 

•  System  baseline  has  survived  close  scrutiny  over  a  period  of 
several  months 

•  Experienced  personnel 

•  Significant  amount  of  off-the-shelf  vendor  items 

•  Harris  experience  in  high  speed  technology 

2.  Real-Time  Reconnaissance  Capability 

•  Utilizes  real-time  Westinghouse  screener 

•  140  Mb/s  Ingest  bus  exceeds  SOW  requirements  and  accommodates 
the  maximum  sensor  bandwidths 

3.  Approved  DHRS  Baseline 

•  Our  DHRS  baseline  has  survived  close  internal  scrutiny 

•  Our  DHRS  baseline  has  survived  customer  reviews  intact 

4.  Flexibility 

•  Easily  acconmodates  alternative  or  future  sensors 

•  Additional  on-line  tape  storage  requires  minimal  software 
modification  only;  except  for  the  added  tape  recorders,  no 
additional  hardware  Is  required 

•  Clean  Interfaces  permit  modular  upgrading  of  DHRS 

•  Selectable  quantization  precision  to  12  bits/pixel 

•  Modular  software  permits  easy  addition/deletion  of  software 
functions 
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5.  Superior  Overall  DHRS  Harrls/WEC  Combinations 

•  WEC  screener  Is  4th  generation  equipment  with  proven  performance 

•  Harris  has  experienced  personnel  with  expertise  In  image 
processing,  high  speed  bus  technology,  and  complex  software  and 
hardware  architectures 

The  benefits  of  using  the  Harrls/WEC  OHRS  are: 

6.  Efficient  and  Effective  utilization  of  Air  Force  Equipment  and 

Personnel 

•  One  Image  Interpreter  has  a  span  of  control  that  accommodates 
many  more  missions  per  unit  time 

•  More  effective  use  of  strike  force  since  less  time  is  spent  in 
air  waiting  for  instructions 
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MISSION 

of 

Rome  Air  Development  Center 

RAVC  plans  and  exec utes  neseanch ,  development,  test  and 
i elected  acquisition  pn.ogn.ams  in  suppont  of  Command,  Contnol 
Communications  and  Intelligence  [Ch]  activates.  Technical 
and  engxneenxng  suppont  uxithin  aneas  of,  technical  competence 
cs  pnovided  to  EST>  Pnognam  Offices  IPOs )  and  othen  ESP 
elements.  The  pnlncipal  technical  mission  aneas  ane 
communications ,  clectAomagnetic  guidance  and  contnol,  sun- 
vex l lance  of  gnound  and  aenospace  obiects,  intelligence  data 
collection  and  handling,  infonmatlon  sustem  technology, 
tonosphenlc  pnopagation,  solid  state  sciences,  micnomie 
physxcs  and  electAonic  ne liability,  maintainability  and 
c  ompatihttitvf . 
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